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ABSTRACT 


A Modifying Model 1s developed which sharpens the 24 hour position forecast 
issued by the Navy Operational Global Atmospheric Prediction model (NOGAPS) 24 
hours into a selected, mid-latitude, Central Pacific cyclone. The technique involves 
measuring cyclone characteristics withm the first 24 hours and using these values in re- 
gression equations to provide improved forecasts for the next 24 hour position forecast. 
Generally, the modified position forecasts are to the left and ahead of the NOGAPS 
position forecasts along the anticipated track of the cyclone. Probability ellipses about 
the Modifving Model estimates cover about 50 to 60 percent of the area of the corre- 
sponding NOGAPS probability ellipses. Only cyclones mn the deepening phase (central 
pressure decreasing) or forecast to be in the deepening phase are utilized in the data 
base. The Modifving Model ts sufficiently srmple that shipboard personnel can make the 


computations in real time. 
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I. INTRODUCTION 


A. BACKGROUND 
Ships at sea are extremely vulnerable to weather conditions. Limited and 

somewhat crude instruments (barometer, anemometer) are available to help the mariner 
measure the weather nearby and anticipate imminent conditions, but there is httle of a 
practical nature that he can do to anticipate weather conditions well in advance of his 
present position and take early avoiding action. Reports and messages from local and 
national weather services provide irreplaceable information on cyclone activity and other 
weather related phenomena which allow the ship at sea to take early avoiding action. 

The Navy Operational Global Atmospheric Prediction Model (NOGAPS) is a 
State of the art, fluid dvnanuc atmospheric general circulation model that simulates the 
characteristics of the atmosphere [Ref: 1]. The model is executed twice daily on a 
mainframe supercomputer at Fleet Numerical Oceanographic Center to analyze and 
predict the atmosphere from the surface to the middle-stratosphere. A separate Vortex 
Tracking Program is used to interpret the NOGAPS analyzed and forecast represen- 
tation of sea-level pressure mid-latitude cyclones. Every 12 hours a new set of pred- 
ictions is issued, covering successive 12 hour periods up to 120 hours from the time of 
the current cyclone forecast. 

Some general, predictive tendencies in the NOGAPS model have been discovered 
through detailed analysis by various researchers. Given certain conditions, predictions 
may follow specific patterns. This, in turn, leads to a rough pattern of prediction errors 
associated with specific cyclone qualities. For example, Harr et al. 1992, [Ref 2: p. 14.] 
note that maximum underforecasting errors (forecast central pressure higher than the 


actual central pressure) occur over the Central Pacific (CPAC) region of climatological 


maximum cyclone deepening. That is, the predictions of central pressure tend to be 
higher than actual when the cyclone’s central pressure is decreasing toward its lowest 


point. 


B. PROBLEM DESCRIPTION 

Knowlege of these errors is qualitative and general. The ability to estimate the 
errors in a given forecast is totally dependent on the skill and experience of the forecas- 
ter. Although research is being conducted to remove or further reduce biases in the 
NOGAPS model. there are no tools which provide forecast error estimates, given=the 
specific parameters of a unique cyclone. However, a simple, statistical model has been 
developed from a data base of previous cyclones to adjust the future position pred- 
ictrons. Using a data base of cyclones from 1989 and 1990 it utilizes parameters ob- 
tainable in the first 24 hours, to predict the next 24 hour cyclone position. The 
prediction 1s in the form of a deviation from the NOGAPS position forecast and can be 
computed bv the ship receiving the NOGAPS forecast, or incorporated into the forecast 


isSMediO (he torecascter. 


C. KEY TERMS AND CONCEPTS 

The position error between the NOGAPS forecast and the actual cyclone posi- 
tion is described by three sides of a right triangle: Forecast Error, Track Error and 
Distance Error Along Track (see Figure 1). Forecast Error (FPE) is delined@assiie 
Straight line distance from the actual position to the forecast position, measured in 
nautical miles (nm). Track Error (TKE) is defined as the distance from the forecast 
position to the nearest position along the actual track of the cyclone, measured in nau- 


tical miles. Distance Error Along Track (DEAT), measured in nautical mules, is defined 


as the distance between the point on the actual track closest to the forecast position (pt 


A) and the actual position (pt C). 


Figure 1. 
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As can be seen from Figure I, Track Error is measured from the predicted posi- 
tion (B) to the nearest position along the actual track (A). Track errors to the left (right) 
are considered negative (positive) and Distance Errors Along Track ahead of (behind) 


the NOGAPS forecast are considered positive (negative). 


D. ERROR ESTIMATE COMPOSITION 

A point estimate prediction for the deviation of the actual position from the 
NOGAPS predicted position will be developed in terms of an anticipated TKE and 
DEAT. A Distance Error Along Track (DEAT) prediction vields one point along the 
intended cyclone track. From this point a predicted Track Error (TKE) right or left will 
result in a position forecast. The Modifying Model position will be developed by ap- 
plving the predicted DEAT and predicted TKE to the NOGAPS forecast. The track 
error estimate is applied in the same direction as Its sign indicates, while the DEAT es- 
timate is applied in the opposite direction. A negative DEAT estimate indicates that the 
NOGAPS prediction will lag behind the actual position. Therefore, the NOGAPS po- 
sition must be advanced in the positive DEAT direction to reduce the expected error. 
For example, a Track Error estimate of + 10nm moves the NOGAPS estimate 10nm to 
the right of track, but a DEAT estimate of -47nm results in the NOGAPS position being 
advanced 47nm along track. The point estimate is computed by adding both estimates 
as in vector addition, starting at the NOGAPS predicted position. Figure 2 displays how 


the Modifying Model point estimate is applied to a cyclone with these error estimates. 
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Figure 2. Applying the Modifying Model Estimate 


Forecast Error (FPE) is not used because it is not a vector, and would generate 
ambiguity. At best it can be used to create an area forecast and not a point estunate. 
For example, an FPE prediction of 60 nautical miles (nm) can be anywhere on a circle 
of radius 60nm from the forecast position. If an FPE prediction 1s combined with either 
a TKE or DEAT estimate an ambiguity developes between four possible points (see 


Figure 3.). A decision would have to be made concerning which predictions to use. 


Figure 3. 
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Ambiguity Illustration using FPE Estimate 





The modelling goal is to provide a modified forecast based on an earlier actual 
position error measured from the NOGAPS forecast. To provide meaningful results, the 
focus of the model is narrow. Its application is limited to Central Pacific, mid-latitude 
cyclones during the third 24 hour position forecast of a deepening or predicted to be 
deepening cyclone. Meaningful variance reduction is possible using this stratification. 
A similar approach could be used during cyclone formation if analysis of that aspect of 
the prediction is desired. 

The effect of twelve parameters on each of the three position error components 
is studied. Each parameter comes from either a cyclone or forecast characteristic, 
measurable within the first 24 hours of forecasting. Regression model predictions of 
Track Error and Distance Error Along Track are developed to provide a point estimate 
for a modified position forecast. Additionally, probabilitv ellipses, based on the 
Bivariate Normal distribution, and following the general principles identified in Ref. 3, 
are created about cach point estimate to allow for model variability and provide a rea- 
sonable area of probability. Regression model coefficients are estimated using the 
Jacknife technique and a set of 20 new cyclones from 1991 is used to validate the model. 

The results are encouraging and indicate that the simple models can provide 
useful enhancements of the NOGAPS predictions. If the results are utilized in a sensible 


manner, both the forecaster and the ship at sea will reap benefits. 


E. DATA BASE SELECTION 
A large data base of mid-latitude, Central Pacific cyclones from 1989-1990 have 
been studied. Over 200 summaries have been reviewed and 57 have been sclected to 
form the data base for the analysis. 
Clearly, 57 cvclones is not a large data base. While there are well over 200 


candidate cyclones, the majority are unuseable for one of the following reasons: (1) 


missing data, (2) deepening phase too short. The first requires little discussion except 
to mention that missing data occur as a result of either an omision of a 24 hour forecast 
Or an omission of the cyclone evaluation at a given 12 hour increment. The second re- 
quires more explanation. 

The Modifiying Model is concerned only with predicting the Track Error and 
Distance Error Along Track during the deepening phase of the cyclone. The deepening 
phase is determined by cyclone central pressure. While the central pressure is decreas- 
ing, the cvclone is deepening. This phase ends when the lowest central pressure is ob- 
served. Therefore, in order for a cyclone to be accepted into the data base, 10s 
satisfy the following critieria: (1) the cyclone must deepen through the first 24 hours 
(when the first two 24 hour forecasts are made), and (2) the third 24 hour forecast must 
predict continued deepening. If a cyclone takes longer than 48 hours to reach its lowest 
central pressure and there are no missing data, it is placed in the data base. However, 
there is difficulty in those cases for which the third 24 hour central pressure prediction 
calls for continuing cyclone deepening but the cyclone does not actually deepen any 
further. These cyclones may not have a deepening phase of at least 48 hours but, the 
model must be applied since the pending 24 hour forecast (although incorrect) calls for 
deepening below the pressure reached 24 hours into the cyclone. When the model is 
apphed, the user has no idea what the low pressure will be or when it will occur. The 
reader is referred to Appendix A which contains descriptions of four cyclones; two which 
were accepted into the data base and two rejected cyclones. 

Previous research (Harr et al, 1992) has shown that position predictions follow 
distinctly different patterns during the deepening and filling (increasing central pressure) 
phases. Thus, mixing cyclone predictions and observations from cyclones which are 


deepening and filling is likelv to degrade modelling efforts. 
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F. PARAMETER DESCRIPTION 

The following list contains 15 parameters extracted from each cyclone summary. 
Numbers 1-12 can be obtained within the first 24 hours of cvclone formation and rep- 
resent the independent variables considered in the modelling of the third 24 hour forecast 
position error. Parameters 13-15 represent the components of the third position error 
after evaluation. The model establishes a position prediction based on predictions of 


parameters [3 and 14. 


Initial Cyclone Latitude 

Initial Cyclone Longitude 

Initial Central Pressure (ICP) 

Central Pressure Aiter 24 Hours 

Cyclone Central Pressure Drop in First 24 Hours 

First 24 Hour Central Pressure Forecast Error 

lest. 24 Tlour Forecast - Track Error (TKE]1) 

First 24 Hour Forecast - Distance Error Along Track (DEAT1) 
9, First 24 Hour Forecast - Forecast Error (FPE1) 

10. Latutude Change in First 24 Flours 

I]. Longitude Change in First 24 Hours 

12. Ratio of Longitude Change to Latitude Change (SLOPE) 
Patiird 24 our Forecast - Track Error (1 KE) 

14. Third 24 Hour Forecast - Distance Error Along Track (DEAT) 
J5. Third 24 Hour Forecast - Forecast Error (FPE) 


te a ee 


All parameters are easily measurable by any reasonably knowlegeable person. An ex- 
perienced navy quartermaster would have no difficulty. 

The first four parameters require no explanation and are read directly from the 
cyclone summarv. Parameter five is simply the difference between three and four. Pa- 
rameter six 1s determined by comparing the first 24 hour central pressure prediction with 
the actual central pressure 24 hours from the time of the forecast. Positive values are 
given if the predicted central pressure 1s higher than the actual. Parameters seven, eight 
and nine are all computed from the difference in actual cyclone position after 24 hours 
and the predicted position as per the definitions previously given. Parameter(s) [0 (11) 
is the difference between the initia] latitude (longitude) and the latitude (longitude) after 


24 hours. Parameter 12 is the ratio of parameter I] to 10 and gives an indication as to 


i] 


the general direction of the cyclone. Parameters 13, 14 and 15 are computed in the same 
manner as 7, 8 and 9 using the actual cyclone position at 48 hours and the 24 hour 


prediction made 24 hours into the cyclone. 
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II. POSITION ESTIMATE DEVELOPMENT 


A. OUTLIER REMOVAL 

Three outhers which affect the DEAT Model and two which affect the Track 
Error Model have been removed from the data base. This reduces the number of 
cyclones to 52. These data points were removed only after careful analysis of residual 
plots and consideration of the random nature of weather. A detailed, step by step 


summary of the procedures used to isolate and remove outliers is discussed in Appendix 


Ibi 


B. MODEL COMPONENTS 

Variable selection is performed separately for each of the two components. The 
resulting model assumes independence of the errors. The same variables were used in a 
multivariate regression version. The results and performance comparisons appear in 
Appendix C. The multivariate regression version did not outperform the present mod- 
elling. 

The Track Error estimate 1s the product of a multiple regression model using two 
variables: First 24 hour Track Error (TKE1!) and Initial Central Pressure (ICP). Anal- 
ysis of the residuals vs fitted values and residuals vs parameter values reveals normality 
and constant variance and satisfies the necessary regression assumptions (See Appendix 
BD). 

The tendency is for the Track Error estimate to be negative (left of track) unless 
the Initial Central Pressure (ICP) is relatively high and the value of TKEI 1s slightly 
negative or positive in any magnitude. Negative values of TKEI and lower ICP’s 


produce negative Track Error estimates. Negative Track Error estimates (left of track) 


are more conumonplace and support the general conclusions of Elarr et al, 1992 [ Ref. 
oe O.|. 

The DEAT estimate is the result of a simple regression model utilizing parameter 
12 (Ratio of the Longitude Change to the Latitude Change, SLOPE). It has been ex- 
tremely difficult to find anv parameters which have any influence on DEAT. There does 
not appear to be a strong relationship to any of the parameters except for the Slope. 
The necessary assumptions in the regression model are satisfied: normalitv and con- 


stant variance of the residuals (see Appendix B). 


C. JACKKNIFE PROCEDURE 

The final regression model coefficients are determined using the Jacknife proce- 
dure. The Jackknife technique is adopted since it allows for validation during the model 
building phase and has bias reducing properties [Ref. 4]. The data base is partitioned 
into k sets (13 in this application) each with n elements (four). The regression model 1s 
developed 13 times successively using 48 cases each time. A different set of four data 
points is excluded each time. The regression model coefficients and constant term values 
are recorded for each of the 13 cases. Residuals are computed using the four excluded 
data points and the fitted values from the regression model developed using the 48 cases 
that do not contain those data points. Thirteen psuedo values are obtained. A psuedo 
value is the difference between 13 times the regression model coefficients from the entire 
data base (52 data points) and 12 times the regression model coefficients from the data 
set without the deleted four data points. The final regression model coefficients are the 
average of the psuedo values. The variables and formulation of the Jackknife procedure 
are described in the following: 

k= number of data sets within complete data set (13), 


yy = regression coefficient using all 52 data points, 
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y, = regression model coefficient with jth data set excluded, 
¥;. = jth estimate of regression coefficent (psuedo value), 
Vn BAX YW, —(K—1)Xy5,, 

y, = final regression coefficient estimate, 


k 


y= (Sy Vk 


aoe 
i=] 


k 
oe [2 a) a) 
J= 
S, = standard error of regression coefficients, and 


S, = SIJk. 


D. COMPLETED MODELS 
The final, jacknifed regression coefficients for the TKE and DEAT models are 


as follows: 
[ik eae 213 7G 03( TE ee ules?) 
and 


apne iG 2 1O\SEOPE! 


E. MODEL LIMITATION 

It is apparent from the final regression model equation for the DEAT that the 
model does not allow for predictions of positive values, yet, a small fraction of all 
cyclones do produce positive values of DEAT. The closest value to zero which can be 
reached 1s -31.16. This occurs when the value of slope is 0. While this constraint on the 
model 1s restrictive, the statistical properties of alternative models are not as good. 
Another option 1s use of the untransformed slope value, which produced the following 


regression model: 


DEAT3 = — 53.26 + 2.32(SLOPE). 

This regression model has the ability to predict positive values of DEAT as slope 
values become larger than +23. This option was not adopted because there were not 
enough slope values greater than +23 in the data base. In fact, the only slope value 
larger than + 23 1s 28.33 (Cyclone 32) which corresponds to a DEAT of -98nm. Since 
the overwhelming tendency 1s for the DEAT to be negative (over 85 percent), and of the 
nine cyclones with positive DEAT’s the largest slope value is 7.25, it is not considered 
prudent to expect larger positive slope values to produce positive DEAT values. Should 
future data reveal a correlation between large, positive slope values and positive values 


of DEAT, a model modification should be considered. 


Table 1. JACKKNIFE RESULTS FOR THE ThKE MODEL 
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Table 2. JACKKNIFE RESULTS FOR DEAT MODEL 
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IY. PROBABILITY ELLIPSE GENERATION 


A. FORMULATION AS A BIVARIATE NORMAL 

There is a high degree of variability in the point estimates, both in the NOGAPS 
forecasts and the Modifying Model forecasts. The forecaster and ship at sea can use an 
enhanced picture of how the cyclone is hkely to deviate from the forecast position. A 
probability ellipse can be constructed about the Modifying Model point estimate to 
serve this purpose. The ellipse is constructed using a bivariate normal distribution where 
the X and Y variables are. respectively, the Track Error estimate and the Distance Error 
Along Track estinate. Probability ellipses can also be generated for the NOGAPS 
forecasts. 

The ellipses for the Modifving Model are generated using the following residuals 
from the track error model (é,) and the distance error along track residuals (é,): 

e(i) = Actual TKE, - Modifying Model TKE,, 

é,(1), é,(2), ..., é,(52) - estimated TKE residuals, 

[S2,3/5280, 

é,~ A(O ASE ), 

and 

efi) = Actual DEAT, = Moditvine  lodel DP aaae 

é,(1), é,(2), ..., é(52) - estimated DEAT residuals, 
[38,]/5220, 


e,~ N(0,MSE,). 


Thus, the Bivariate Normal is assumed for each pair of residuals ( é,(d), e,(d) ), 
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and 


“a Ss? = 
Seas: 


where C 3s the Covariance Matrix and 








n 
\ ree 
S3=—t 240 } = 3207 
nr 
S} = £918,979 = 3253 
/=) 


] : A oan 
Sy = 24080) = 997.5. 


The density function for the bivariate normal is 
ell 
~)2 


flxy) = ce™' 


where c = constant and 


Under the assumption of normally distributed errors, Q is a Chi-Squared random 
variable with two degrees of freedom ( 2) ). The size of the ellipse for a desired proba- 
bility level, 1 — «, is equal to Q = &? when o = P[y2, > k?]. Using the basic equatiomeam 
an ellipse and the assumption of independence, the points on the ellipse can be generated 


(x, =IKE estimate, y, = DEAT estimate ), and 


2 2 
(Se X)) raat 2 
a 
Ss S; 
which implies that 
2 
Pan Ecce |) 
y= ae S k 
) ee 


The variable y represents an envelope of points corresponding to the series of 
points on either side of the TKE estimate. The choice of « determines k?, which in turn 
determines the size of the ellipse. The major and minor axis lengths can be determined 
by selecting the value of y when x = x,, and the value of x when y = 0. For example, 
using a significance level of o = .25, A? = 2.78 and the major (x) axis (axis along TKE) 
was 95.1 and the minor axis (y) (axis along DEAT) was 94.4 nautical miles. These dis- 
tances can be easily marked about the point estimate, referenced to the intended track, 


and curves marking the ellipse can be drawn by shipboard personnel. 


B. COMPARISON OF NOGAPS AND MODIFYING MODEL ELLIPSES 
Probabilty ellipses can be generated for the NOGAPS forecast in the same 


vy, = 0. The variances of the NOGAPS Track 


o 


manner. For the NOGAPS estimate, x, = 
Error residuals and the Distance Error Along Track residuals were much greater than in 


the Modifying Model. The values are shown below: 
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[> 2,()"] = 4420, 
/= 


eee 
S=— [> 8,()") = 7787, 
j= 





and 


mon ee 
Sy =—L 280) BO 0GS. 


Therefore, a probability ellipse corresponding to the same a value as for the 
Modifying Model Ellipse is much larger. For the case where a = .25, the major (¥) axis 
( axis along DEAT) was 145.7 and the minor (x) axis (axis along TKE) was 109.8 nau- 
tical miles. Figure 4 shows a comparison of the NOGAPS ellipse and the Modifying 
Model ellipse using a = .25. and shows how the Modifving Model ellipse 1s much more 
like a circle than the NOGAPS probability ellipse. The area comparisons for the 75 
percent ellipses are as follows: NOGAPS = 50,259 nn? and Modifying Model = 28,203 
nny, 

Since the Modifving Model ellipses are smaller than the NOGAPS ellipses, a nice 
advantage can be obtained through their utilhzation. However, it should be demon- 
strated that the smaller ellipses perform to the desired level. In other words, the accu- 
racy of the Modifying Model ellipses should be verified. This task 1s undertaken 1n the 
next chapter with fresh data, but was, also, started utilizing a weaker forin of cross val- 


idation from the results of the Jackknife procedure. 
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Figure 4. Comparison of NOGAPS and Modifying Model Ellipses 
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C. PROBABILITY ELLIPSE VALIDATION 

Using the partition of the data set accomplished during the Jackknife procedure 
in Chapter IJ, predictions of the deleted four data points from the remaining 48 cases 
are made. The residuals are computed and each pair (one from each model) was plotted 
in the Cartesian plane. A 75 percent probability ellipse was plotted about the pairs of 
residuals using the formulation previously developed. The 75 percent probability ellipse 
should, therefore, contain about 39 of the 52 residual pairs. As can be seen from Figure 
5, only 12 residual pairs are clearly outside the ellipse and two are on the boundary. 
Thus, approximately 75 percent of the data points are contained within the ellipse and 
this portion of the validation may be considered successful. 

A 95 percent probability ellipse is, also, plotted. Seven points are clearly not 
contained within the ellipse with two more on the boundary. Therefore, this ellipse 
seems to perform at less than a 95 percent rate of efficiency (approximately $3 percent). 


Similar performance is noted with the validation data. 
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Cross Validation of Probability Ellipses 


IV. MODEL VALIDATION 


A. DATA SET 

A data set of 20 cyclones from 1991, which met the same criteria as the cyclones 
in the data base, is used for separate validation. They seem to provide an adequate 
representation of the mix which occur over an extended time period. In passing it is 
noted that five of the 20 contain positive DEAT’s, compared with nine of the 57 in the 
original data base and eight out of 52 in the data base after removal of outliers. Each 
variable required in both models is derived from the 20 cyclone summaries. Utilizing 
each model, a position estimate is developed for each 48 hour position, based on the 24 


hour cyclone position prediction made 24 hours into the cyclone. 


i =RESULTIS 

For each cvclone there is a NOGAPS estimate, the Modifying Model estimate 
and the actual cyclone position. The NOGAPS TKE and DEAT , the Modifying Model 
TKE and DEAT predictions and the resulting FPEs for each model are computed and 
compared. They are displaved in Table 3. 

Since the Forecast Error component of the position error represents the straight 
line distance from the predicted position to the actual, it was chosen as the primary 
measure of effectiveness of the Modifying Model, though several other MOE’s will be 
discussed. The difference between the sum of the forecast errors over all 20 cyclones for 
the NOGAPS estimates and the Model estimates was -353nm. Thus, the Modifving 
Model improved each forecast by an average of 18nm, or 20 percent over all 20 cases. 

The hypothesis that the Forecast Errors in both cases are equal could be rejected 
at the « = .02 significance level using a Paired T Test and the individual FPEs (columns 


five and six of Table 3) for each method of position estimation [Ref 5]. Therefore, with 


o5) 


Table 3. COMPARISON OF NOGAPS AND MODIFYING MODEL ERRORS 


Cyclones MODEL ING MODEL 
[TRE [DEAT | KE | DEAT] FPE | FPE 
: 








a high degree of confidence one can conclude that the Forecast Errors are smaller using 


the Modifying Model. The Paired T test results are given below: 


D—0O 


Sif 


where 
D.= NOGAPS FPE = MODIFYING MODEL 2s 


aS One nes. 
t=] 
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$= [S(D,— Dyn - 2) = 1279.5, 
S)in a 7.999, 

T = 2.206, v = 19, 

and 


ga 0)’ 


The vahdation results can be analyzed in several other ways. For example, the 
Forecast error is smaller using the Modifying Model in 16 out of the 20 cases for an ef- 
fectiveness rating of 80 percent. 

Additionally, the NOGAPS prediction can be viewed as the center of an (x,y) 
coordinate system, with four quadrants corresponding to each pair of possible positive 
and negative values of the TKE and DEAT (Figure 6). Each Modifying Model estimate 
adjusts the NOGAPS prediction and establishes a position in one of these four quad- 
rants. In 14 out of 19 cases in the validation set, the Modifving Model places the 
cyclone position in the correct quadrant. In the remaining case, the Track Error esti- 


mate is zero but the DEAT estimate is in the correct direction. 


oy 


IKE + IKE 
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Figure 6. Illustration of Quadrants in Position Estimation 
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C. TRACK ERROR ANALYSIS 

The Modifving Model did well in correctly anticipating the Track Error direction. 
In 15 out of 19 cases, the model forecast a track error on the correct side of track. In 
the remaining case, the Modifving Model forecast no track error when the actual is a 
small error feft of track. Anticipated Track Error direction can be particularly useful if 
decisions must be made concerning manuevering around a cyclone. In each of the four 
cases in which the track error direction is incorrectly forecast, the actual track error is 
to the right of track (positive). The model only forecast track errors to the right of track 
twice and was correct both times. Thus, if a cyclone in the validation set had a track 
error left of track (negative) it was correctly forecast 100 percent of the time and, if the 
Modifying Model forecast a Track Error right of track, it was correct 100 percent of the 
time. Obviously, these occurrences do not represent absolutes but do give some insight 
into the workings of the Track Error model. A Track Error prediction right of track 1s 
less common, but more likely to be correct when it 1s made. 

The Modifying Model Track Error estimate 1s closer to the actual track error in 
14 of the 20 cases. with four of the six due to incorrect predictions of the track error 
direction. Six predictions are within 10nm of the actual track error and in the correct 
direction. Another five are within 20nm. 

The Track Error between the Modifying Model prediction and the actual position 
can be computed by subtracting the Track Error estimate of the Modifving Model (col- 
umn three from Table 3) from the Track Error of the NOGAPS prediction (column one 
from Table 3). The sum of these differences can be compared to the sum of the errors 
from column one to determine the amount of error reduction which 1s achieved. The 


fegmit 1s 23 pereent. 
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D. DISTANCE ERROR ALONG TRACK ANALYSIS 

The DEAT model predicts the correct direction of the Distance Error Alome 
Track I5 out of 20 times. Each time there is a positive DEAT, the Modifving Model 
produces an incorrect prediction. The Modifying Model DEAT produces an estimate 
closer to the actual DEAT 1n 14 of the 20 cases. Five of the six poorly forecast Gases 
are those in which the actual DEAT 1s positive. 

Of the fifteen cases in which the direction of the DEAT is correctly forecast, the 
Modifying Model overforecast the DEAT in six cases and underforecast the DEAT in 
nine. Of the nine cases which are underforecast, three involve cases in which the actual 
DEAT its larger than 160nm (in the negative direction). Therefore, among the cases in 
which the actual DEAT 1s moderate, there is no discernable bias in the DEAT forecasts 
of the Modifying Model. 

The DEAT component of the error between the Modifying Model estimate and 
the actual position can be computed by subtracting the DEAT estimate of the Modify- 
ing Model (column four of Table 3) from the DEAT of the NOGAPS forecast (column 
two of Table 3). The sum of these differences can be compared to the sum of the actual 
DEAT’s (column one) to determine the amount of DEAT reduction which 1s achieved. 


The resnit is a 1570 rea iction. 


E. PROBABILITY ELLIPSE PERFORMANCE 

The performance of the probability ellipses discussed in Chapter III 1s analyzed 
on all 20 cases in the validation set. Three different probability ellipses are studied: 50, 
75 and 95 percent. Eleven out of 20 cyclone positions are contained within the 50 per- 


cent ellipse, for a performance rate of 55 percent. Fifteen are within the 75 percent el- 
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lipse (75 percent performance rate) and !8 are contained within the 95 percent ellipse (90 


percent performance rate). These results are very favorable. See Iigure 7. 
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Figure 7. Probability Ellipse Performance 
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Probability elhpses about the NOGAPS estimates contain more of the actual 
cyclone positions than the Modifying Model estimates. However, this is attributable to 
the much larger probability ellipses about the NOGAPS model estimates. Ellipse size 


comparisons are listed below in Table 4. 


Table 4. NOGAPS AND MODIFYING MODEL ELLIPSE COMPARISON 


TT NOGAPS «Modifying Model 
CC EN 















V. CONCLUSION 


The modelling introduced in this thesis has a positive impact on the accuracy 
of NOGAPS cyclone position predictions. Using several different Measures of Effec- 
tiveness, summarized in Table 5, the modelling reduces the magnitude of the component 
errors by approximately 20 percent and anticipates the error tendencies in their various 


forms with an accuracy rate of approximately 75 percent. 


Table 5. MOE SUMMARIES FROM THE VALIDATION DATA 


FPE Reduction 
Position Estimate in Correct Quadrant 14/19 


Modifying Model FPE < NOGAPS FPE 


TRE Reduction 
TKE Prediction in Correct Direction loyal eS 


Modifying Model TKE < NOGAPS TKE XY 


DEAT Redaction 
DEAT Prediction in Correct Direction 


Modifying Model DEAT < NOGAPS 15,20 715% 
DEAT 


A simple illustration provides the best evidence of how the modelling can have 






















a significant impact on the decision making process of the at sea commander when a 
manuevering decision must be made in response to the presence of a cyclone. Figure 8 
depicts a hypothetical situation in which the present position of a storm, its 24 hour 
predicted position and therefore, its predicted course, and ship’s position are plotted. 
Additionally, a circle of radius 150nm representing the hypothetical radius of 30 kt winds 


about the predicted 24 hour position ts, also, plotted. The cyclone is predicted to move 
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at a speed of 18nm per hour, perpendicular to the ship’s intended course. The ship is 
510nm from the 24 hour predicted postion and desires to procede at I5kts. If the ship 
does not alter course and or speed it will enter the circle of 30 kt winds at the exact time 
the storm 1s forecast to reach the 24 hour position. Clearly, this is not prudent and a 
manuevering decision must be made. 

Prudent seamanship precludes speeding up and manuevering to cross ahead of 
the intended cyclone path. Therefore, the decision involves how best to let the cyclone 
pass ahead and then manuever to regain the desired track. Using only the plot in Figure 
$8, the shipboard commander may choose to maintain course and reduce speed enough 
to remain safely outside the 30kt envelope or he mav choose to adjust course to the night 
and steer for the bottom edge of the 30kt envelope. 

In Figure 9, the Modifying Model estimate 1s apphed to the NOGAPS position 
and a 75 percent probability ellipse 1s constructed about the Modifving Model position. 
The estimated range of 30 kt winds (150nm) 1s plotted from the boundary of the proba- 
bility ellipse. The picture has now changed dramatically. What seemed to be a safe 
manuever, given the first illustration, may be hazardous. If remaining outside the circle 
of 30 kt winds is very important to the shipboard commander, a better course of action 
would be to loiter in the present area or turn futher right to more safely pass astern of 
the cyclone. 

The plots utihzing the Modifying Model are easy to construct following a simple 
checkhst and, easy to read. They provide the decision maker with more information 
upon which to base his manuevering decisions and do not seek to replace the NOGAPS 
position predictions. They work in conjunction with NOGAPS to provide the best 


possible information. 
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Figure 8. Decision Making Plot using only NOGAPS 
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Figure 9. Decision Making Plot with Modifying Model Enhancement 
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APPENDIX A. SAMPLE CYCLONES 


The following are descriptions of four cyclones which were considered for inclu- 
sion in the data base. Tables 6 and 7 depict cyclones which were accepted into the data 
base and Tables 8 and 9 represent cyclones which were rejected. The predictions are for 
24 hours from the time of the associated observation. The accuracy of a prediction can 
be evaluated by comparing it to the observation recorded 24 hours later. For example, 
using Table 6, at O000Z on 28 October 1989 the central pressure was observed to be 
1007mb. The prediction of central pressure for 24 hours from that time (00007, 29 Oc- 
tober) is 1001mb. The actual central pressure at that time 1s 1002mb which corresponds 
to the observation at 89102900. Thus, the error of the central pressure prediction is 
— Imb. 

Table 6 displays a cyclone which does not have a deepening phase of 48 hours. 
It 1s accepted into the data base because the third 24 hour forecast issued at §9102900 
calls for continued deepening below the observed central pressure at that time. The 
cyclone in Table 7 1s accepted because the deepening phase is 48 hours. The cyclone in 
Table § 1s rejected because the third 24 hour prediction at 90031712 calls for the central 
pressure to increase. Additionally, the deepening phase of the cyclone is only 12 hours. 
The cyclone in Table 9 has a deepening phase of only 24 hours and the third 24 hour 


forecast at 89100912 predicts filling (increasing central pressure). It is therefore, rejected. 


oH 


Table 6. ACCEPTED CYCLONE 


PRESSURE 

















Table 7. ACCEPTED CYCLONE 
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Table 8. REJECTED CYCLONE 


PRESSURE 
SEES —- erat 
















Table 9. REJECTED CYCLONE 
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APPENDIX B. OUTLIER REMOVAL 


A. DISTANCE ERROR ALONG TRACK MODEL 

Starting with the Distance Error Along Track Model and referencing the plots 
of studentized residuals (Figure 10), all points are roughly within two standard devi- 
ations of the mean with the exception of three. From the complete data summary listed 
in Appendix D, these points correspond to cyclones 9, 14 and 41. Cyclones 9 and 14 
are two of the three poorest forecasts in the entire data base and contain the second and 
third largest DEAT’s. Unlike the largest DEAT in the data set (cyclone 44), which has 
an extremely high value of Slope and, therefore, a better prediction resulting in a small 
residual value, the Slope values for cyclones 9 and 14 are moderate and small, respec- 
Tivels: 

The DEAT for cyclone 41 1s over 50 percent larger than the next largest positive 
DEAT in the data set, which itself is 66 percent larger than the third largest positive 
DEAT in the data set. It was removed to leave a data set which contains all residuals 
within two standard deviations of the mean. 

Additionally, Figure 10 shows two plots of the residuals versus the Normal Dis- 
tribution for all 57 observations. Both the Chi-Squared and Kolmogorov-Smurnov Sta- 
tistics support rejection of the assumption of normal residuals if a =.10. When the 
three cyclones are removed from the data base, the residual plots are greatly enhanced 
(see Figure 11) and the hypothesis of normal residuals can not be rejected at any rea- 


sonable significance level. 
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B. TRACK ERROR MODEL 

With respect to the Track Error model, two cyclones, 45 and 51, are considered 
to be outliers. The TKE of Storm 45 1s the largest TKE in the data base by 47nm and 
23 percent larger than the second largest. It corresponds to a small negative TKEI (-25) 
and ICP (1006mb) right at the average. Cyclone 51] has one of the highest positive 
TKE’s, but not the largest. It is unique because no other cyclone in the data base with 
a positive TKE has as large a negative TKEI. In fact, only 9 out of the 28 cases with 
positive TKE’s had negative values of TKEI]. Cyclone | has the next most radical dif- 
ference between a negative TKE1 and positive TKE. Clearly, this difference does not 
have the magnitude of that of cyclone 51. 

Additionally, residual plots (Figure 12) show both cyclones 45 and 51 to have 
residuals larger than 2.5 standard deviations from the mean, while all others plot within 
two standard deviations. The residual plots for the TKE model versus the normal dis- 
tribution support the normality assumption. 

Finally, Figure 13, shows the residual plots of the TKE model with storms 45 
and 51 removed (52 data points) and Figure 14 displays the residual plots for the DEAT 


model after all outhers have been removed. 


C. SUMMARY OF MODEL SPECIFIC DATA 

The following two tables summarize the changes in the major regression pa- 
rameters over the course of the process of outlier removal. Note that as the data base 
goes from 57 to 54 points, outliers affecting the DEAT model are being removed, while 
in moving from 54 points to 52 data points outliers affecting the TKE model are re- 
moved. Therefore, the model parameter changes in Table 10 are more dramatic between 
57 and 54 data points, and the more dramatic changes occur between 54 and 52 data 


points in Table 1]. 
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Table 10. CHANGES IN DEAT MODEL AS OUTLIERS ARE REMOVED 
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Table 11. CHANGES IN TKE MODEL AS OUTLIERS ARE REMOVED 
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D. STATISTICAL TEST FOR OUTLIERS 

A statistical method is used to test each data point’s significance as an outlier 
to bolster the assertions made in the preceeding paragraphs concerning outlier removal. 
The test involves deleting one data point to determine the difference between the model 
coefficient estimates without this one data point (using 51 data points) and mode! coef- 
ficient estimates using all 52 data points [Ref 6: pp. 113-117]. This process is repeated 
for each point in the data set. A T-Statistic is generated for determining the significance 


level of this difference. Fortunately, a general formula can be used to compute the T- 


statistic for each data point without having to run n different regressions. The variables 


and formulation are listed in the following: 
n = number of distinct data points (57), 
p’ = # independent variables + | (intercept term), 
x, =p’ x 1 matrix of independent variables for the ith case, 
B_, = regression coefficients generated from n-! cases excluding the ith, 
y; = 1th response variable, 
y, = estimate of the ith response using regression estimates from n-! cases (ex- 


cluding the ith case), 


y, ona oss 
o?, = variance estimate with the ith observation removed, 
and 


Var(y,) = a2, (ATA) x7. 


If there are no outliers then, E(v,—y,)=0 for all i. A Student’s T-test of the 


hypothesis E(y, —3:) = 0 is as follows: 


ama ; 
SS ee VE pp — I. 
A / 


eee 
| (Tyr \-! 
O_pj/) + x{A_LjA_j) x; 


The T-statistic formula can be converted to the following general formula 


where r, = ith Studentized residual. 


This T-statistic is computed for each of the 57 points in the data set for each 


model. Each of the data points mentioned previously as outliers (three in the DEAT 
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model and two in the TKE model) generates T-statistics which are significant at the 


o% = .02 level. No other points in either model obtain this level of significance. 


FE. TEST FOR INFLUENTIAL POINTS 

Due to the nature of the regression plot of DEAT versus Slope (see Figure 15), 
there 1s some concern over the influence on the model, of the two large, negative values 
of DEAT, corresponding to two large values of Slope (Cyclones 44 and 50). Cook’s 
Distance formula is used to determine if either point has an unduely large influence on 
the model. The formula quantifies, in a meaningful way, the magnitude of the difference 
between the model estimates of the regression coefficients with all data points and the 
coefficient estimates excluding the ith. Cook’s Distance, D, roughly represents the 
squared distance between the two estimates scaled by the variance of the data [Ref. 6: 
pp. 106-109.}. The larger the value of D, the larger the influence of the data point. The 
general rule is that if the value of D, 1s larger than 1, the 1th case may be judged to be 
influential. 


The general formula for computing D, follows: 


‘shale ale 
D; = p' r; ( 1-1; lk 


Wiiere 

v, = xX{(XTA_)x? = diagonal elements of the Hat matrix, 

and 

— = the distance from the ith, deleted data point, to the means of the remain- 


tr 


ing, n-1 data points. 
If the distance from the deleted data point to the n-1 means 1s large, a large value 


of D, may result. A large value of D, may also occur when r, 1s large. While the values 
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of D, for the two data points in question are high relative to the other data points, they 


are not close to 1.00 (.79 and .58) and therefore, are not determined to be influential 


Cases. 


The TKE Model was not tested for influential points since the residual plots 


followed a much more symmetrical and traditional pattern. 
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Figure 11. DEAT Model - 54 Data Points 
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Figure 12. DEAT Model - 52 Data Points 
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Figure 14. TKE Model - 52 Data Points 
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APPENDIX C. MULTIVARIATE ANALYSIS 


As mentioned in Chapter II, a multivariate analysis has been conducted in order 
to examine the effect of the correlation between the DEAT and TKE jRef. 7 |/anqaig 
comparison with the model which was adopted. The adopted model was tested more 
thoroughly and assumes independence between the TKE and DEAT. The correlation 
between the NOGAPS TKE and DEAT was 0.19. The correlation between the TKE and 
DEAT, after applving the Modifving Model estimate, is 0.09. Due to these low corre- 
lation values, particularly in the Modifying Model case, the independence assumption 1s 
considered tenable. 

Each of the three independent variables, TKEI, ICP and SLOPE, used tna 
regression models previously developed, is used in a composite analysis to estimate TKE 
and DEAT. The same 52 data points and Jackknife procedure is employed. The final 


regression model coefficients for the multivariate regression model are as follows: 


DEAT Composite: DEAT = —1624.7 + 0.31(TKE1) + 1.6(ICP) — 0.2(SLOPE) 
and 


TKE Composite: TAKE =—1091.6 + 0.04(TKE]) +1.05(ICP) — 2.1(SLOPE). 


Cross validation is conducted using the 52 pairs of residuals from the jackknife 
technique. The residuals are plotted and have the same general pattern as the model 
assuming independence between TKE and DEAT (see Figure 16). Figure 16, also, shows 
a comparison between a 75 percent multivariate probability ellipse (A) and the inde- 
pendence model 75 perecent probability ellipse (B). The multivariate ellipse is tilted 


slightly to account for the correlation between the TKE and DEAT. Thus, unlike the 


previously developed ellipse, which is oriented along the intended cyclone track, the 
multivariate ellipse is tilted off the intended cyclone track and, is more difficult to plot. 
Also, the multivariate probability ellipse appears less like a circle. 

As indicated in Figure 16, the multivariate model does not appear to perform 
as well as the adopted model. The 75 percent probability ellipse contains only 69 percent 
of the points (36 out of 52). Figure 17 1s a composite of figure 16A and 16B with the 
residual pairs from both models plotted. An association between model residuals seems 
to exist when the residuals are large in both models. There appears to be less association 
when the residuals are small. Figure 17, also, shows that the multivariate ellipse covers 
slightly less area than the independent models’ ellipse. Proportionately increasing the 
multivariate ellipse to the same size would place only one more residual pair in the ellipse 


and not raise the percentage to 75 percent. 
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Figure 17. Figures 16A and 16B superimposed 
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APPENDIX D. DATA BASE 


The following table gives a complete list of all five variables for each of the 57 


cyclones in the original data base. 


Table 12. COMPLETE DATA SET 
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